CENTRAL LIMIT THEOREM FOR HOTELLING'S 
STATISTIC UNDER LARGE DIMENSION 
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Abstract. In this paper, we prove the central hmit theorem for HoteUing's 
statistic when the dimension of the random vectors is proportional to 
the sample size. 



1. Introduction and main results 

Since the famous Marcenko and Pastur law was found in p^, the theory of 
large sample covariance matrices has been further developed. Among others, 
we mention Jonsson [H] , Yin [21], Silverstein [TS], Watcher [23], Yin, Bai 
and Krishanaiah [25]. Lately, Johnstone [T3] discovered the law of the largest 
eigenvalue of the Wishart matrix, Bai and Silverstein [5] established the central 
limit theorems (CLT) of linear spectral statistics, and Bai, Miao and Pan [2J 
derived CLT for functionals of the eigenvalues and eigenvectors. We also refer 
to [12], [22], [9] for CLT on linear statistics of eigenvalues of other classes of 
random matrices. 

The sample covariance matrix is defined by 

1 " 

^ = - 

n 

where s = ^ and Sj = {Xij,--- ^Xpj)'^. Here {Xjj}, i,j = • ■ ■ , is 

a double array of independent and identically distributed (i.i.d.) real r.v.'s 
with EXii = and EXf-^^ = 1. However, in the large random matrices theory 
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(RMT), the commonly used sample covariance matrix is 

1 " 1 

where = (si, ■ ■ ■ ,s„). 

Note that 5 = S — ss'^ and thus by the rank inequality there is no difference 
when one is only concerned with the limiting empirical spectral distribution 
(ESD) of the eigenvalues in large random matrices. Therefore the limiting 
ESD of S is Marcenko and Pastur's law Fc{x) (see [16] and [H]), which has a 
density function 

^y {b — x){x — a) a < x < b, 
otherwise 



Pc[x) 



and has point mass 1 — c ^ at the origin if c > 1, where a = (1 — a/c)^ and 
6 = (1 + a/c)^. The Stieljes transform m{z) of Fc{x) satisfies the equation (see 

m) 

(1.1) m{z) = , 

1 — c — czm[z) — z 

where the Stieljes transform for any function G{x) is defined by 

mciz) = [ -^dGiX), zeC-^ = {zeC, v = '^z>0}. 

J A — Z 

Observe that the spectra of n^^X„X^ and n~^X^X„ are identical except for 
zero eigenvalues. This leads to the equality 

(1-2) rnl{z) = -^-^ + ^m^M, 

and therefore 

1 r 

(1.3) z = 



m{z) 1 + m{z) ' 

where m^{z) and zzin(^) denote, respectively, the Stieljes transform of the ESD 
of n~^X„X^ and n~^X^X„, and, correspondingly, m(z) is the limit of ZZln(^)- 

Sample covariance matrices are also of essential importance in multivariate 
statistical analysis because many test statistics involve their eigenvalues and/or 
eigenvectors. The typical example is statistic, which was proposed by 
Hotelling [10]. We refer to [1] and [15] for various uses of the statistic. 

The statistic, which is the origin of multivariate linear hypothesis tests 
and the associated confidence sets, is defined by 

(1.4) T' = n{s-fiofS-\s-fio), 
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whose distribution is invariant under the transformation s^- = S^^^Sj,j = 
1, 2, ■ ■ ■ , n with S any non-singular phy p matrix when ^tg = 0- If {^i, ■ ■ ■ , s„} 
is a sample from the p-dimensional population N[n, S), then [T^ / (n— 1)] \{n— 
p)/p\ follows a noncentral F distribution and moreover, the F distribution is 
central if /x = /xq. When p is fixed, the limiting distribution of for fj, = fio 
is the x^- distribution even if the parent distribution is not normal. 

In recent three or four decades, in many research areas, including signal 
processing, network security, image processing, genetics, stock marketing and 
other economic problems, people are interested in the case where p is quite 
large or proportional to the sample size. Thus it will be desirable if one can 
obtain the asymptotic distribution of the famous Hotelling's statistic when 
the dimension of the random vectors is proportional to the sample size. It 
is the aim of this work. In addition, we would like to point out that some 
discussions about the two-sample statistic under the assumption that the 
underlying r.v.'s are normal were presented in [3]. 

Before stating the results, let us introduce some notation. Let m{z) = 
J{x — z)~^dFc{x) and mn{z) = J{x — z)~^dFc„{x), where c„ = p/n and Fc^{x) 
denotes Fc{x) by substituting for c. 

The main results are then presented in the following theorems. 
Theorem 1. Suppose that: 

(1) For each n Xij = X^pi,j = 1,2,--- , are i.i.d. real r.v.'s with EXu = 
jd, EXf^ = 1 and EXf^ < oo. 

(2) p < n,Cn = p/n c ^ (0,1) as n ^ oo. 
Then, when = Ho = {fi, ■ ■ ■ , ^) , 

We will prove Theorem [T] by establishing Theorem [2] which presents asymp- 
totic distributions of random quadratic forms involving sample means and 
sample covariance matrices. 

For any analytic function /(•), define 

/(5) = U^dza^7(/(Ai),---,/(Ap))U, 

where \J'^diag{Xi, ■ ■ ■ , Ap)U denotes the spectral decomposition of the matrix 
S. 

Theorem 2. In addition to the assumption (1) of TheoremUl suppose that 
Cn = p/n — s> c > 0, EXu = 0, g{x) is a function with a continuous first deriv- 
ative in a neighborhood of c, and f{x) is analytic on an open region containing 
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the interval 

(1.5) [/(o,l)(c)(l-v^)^(l + v/^r]• 
Then, 

M^j^- I /(x)rfF,„(x)],v^((7(s^s)-^7(c„))^ ^(X,y), 

where Y ~ N{0,2c{g'{c)y) , which is independent of X , a Gaussian r.v. with 
EX = and 

(1.6) VariX) = ^ f{x)dF,ix) - ( j f{x)dF,{x)f^ . 

Remark 1. Let x„ = (x„i, ■ ■ ■ ,Xnp)'^ € MP, ||x„|| = 1 where \\ ■ \\ denotes the 
Euclidean norm. Note that, when max Xni (see (1-16) in [17j or [20[). 

i 

(1.7) v^[x^/(5)x„ - j f{x)dF,„ix)] ^ X. 

Therefore, s/||s|| can be treated as a fixed unit vector x„ when dealing with 
s^/(5)s/||s|p. 

Theorem [2] relies on Lemma [1] below, which deals with the asymptotic joint 
distribution of 

Xn{z) = Vn f ..^P — ^ - mn{z)], Yn = y/n{g{s^s) - g{cn)). 

IpII 

The stochastic process Xn{z) is defined on a contour C, given as below. Let 
f > be arbitrary and set Cu = {u + ivo,u G [ui, Mr]}, where ui is any negative 
number if the left endpoint of (11.51) is zero, otherwise ui is any positive number 
smaller than the left end-point of (11.51) . and Ur any number larger than the 
right end-point of (11.51) . Then define 

iv : V ^ [0, Vq]} U U + if : f G [0, fo]} 

and let C~ be the symmetric part of about the real axis. Then C = C^UC~ . 

We further define Xn{z), a truncated version of Xn{z), as in [5]. Select a 
sequence of positive numbers pn satisfying for some P G (0, 1), 

(1.8) p„iO, p„>n-^. 
Let 

{ui + iv : V e [n^Vn, Vq]}, if Mi > 
{ui + iv : V E [0, Vq]}, if M; < 



and 



{ur + iv -.v e [n Pn,Vo]} 
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Write = Ci U Cu U Cr. We can now define the truncated process for z = 

u + iv E C hj 

(1.9) 

(Xn{z), if zee:: uc- 

where Zr\ = Mr + in'^Pn, Zr2 = Ur- in'^pn, zii = ui + in" Vn, Zi2 = ui- Vn 
and C~ denotes the symmetric part of C+ about the real axis. Then 
may be viewed as a random element in the metric space C{C, M^) of continuous 
functions from C to M^. We are now in a position to state Lemma [TJ 

Lemma 1. Under the assumptions of Theorem{^ we have for z e C, 

(x„(z),r„) ^{xiz),Y), 

where Y ~ A^(0, 2c{g'{c))'^) , which is independent of X{z), a Gaussian stochas- 
tic process with mean zero and covariance function Cov{X{zi),X{z2)) equal 
to 

Q 1 2m{zi)m{z2) 

cziZ2[{l + rn{zi)){l +ZZ2i(-22)) - crn{zi)'m{z2)\ c 

Remark 2. Also, note that X{z) is exactly the weak limit of the stochastic 
process y^(x^(S — zY)~'^)^n — f^niz)) when maxa;„j 0, whose covariance 

i 

function is, 

rm,(X(7 \ X(~\-\- ^{Z2rn{z2) - zim{zi)f 

C0V{X[Z,IX{Z2)) - 

(see [2] and [T7] ). 

We conclude this section by presenting the structure of this work. To transfer 
Lemma [T] to Theorem [2] we introduce a new empirical distribution function 



;i.ii) Fl{x) = Y,tp{\<x) 



i=l 

where t = (ti, • ■ ■ = Us/||s|| and U is the eigenvector matrix of S. It 

turns out that i^2^(x) and the ESD of S have the same limit. That is, Ff{x) 

Fc{x). Thus, s-^/(«S)s/||s|p in Theorem [2] is transferred to the Stieljes 
transform of F2{x). Moreover, note that 
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where A~^{z) = (S — zl)^^ . Indeed, this is from the identity 



^1.13) r^(B + arr^)"^ 



1 + ar^B-ir' 



where B and B + arr'^ are both invertible, r G and a G M. The stochastic 
process Xn{z) in Lemma [1] is then transferred to the stochastic process Mn{z), 
where 



1 + CnmJz) 



The convergence of the stochastic process Mn{z) is given in the next two 
sections. The proofs of Theorems [1], Lemma [1] and Remark [2] are included in 
section 4. The last section picks up the truncation of the underlying r.v.'s. 

Throughout this paper, to save notation, M may denote different constants 
on different occasions. 



2. Weak convergence of the finite dimensional distributions 

For ^ G C+, let Mn{z) = Mi^\z) + Mi^\z), where 

mW(2) = ^{s^A-\z)s - Es^A-\z)s), 

and 

In this section, the aim is to prove that for any positive integer r and complex 
numbers 



i=l 



converges in distribution to a Gaussian r.v., and to derive the asymptotic co- 
variance function. Before proceeding, r.v.'s need to be truncated. However, we 
shall postpone the truncation of r.v.'s until the last section. As a consequence 
of Lemma [71 we assume that the underlying r.v.'s satisfy 



(2.1) \Xi,\ < SnV^, EXu = 0, E\Xu\^ = 1, E|Xn|' < 



oo, 



where e„ is a positive sequence which converges to zero as n goes to infinity. 
We begin with a list of notation, mathematical tools and estimates. 
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2.1. Notation, mathematical tools and estimates. We first introduce 
some notation. Let Aj(z) = A(z) — n^^SjS^ , ^ij{z) = A{z) — n^^Sisf — 

^'^'^ = l + is[ATi(^)s,-' ^^^'^'^ ^ i + ltrAT\zy ^'^'^ ^ l + ^EtrA^\z'' 
7,(z) = -sJAt1(^)s, - -trA-T\z), i,{z) = -sJAt1(^)s, - -EtrA-^\z), 
aj{z) = -sj Aj^{z)sjsJ Aj'^{z)sj~--sJ Aj^{z)sj, Aj{z) = Aj^{z)sjsJ A~^{z), 

^"■^'^ ^ TTI?I^' ^^^'^ = l + ^JrA^izY ^''^'^ = l + lEtrA',^[zy 
and 

iij{z) = -sjA-/{z)s, - -EtrA^^\z), 7i,(z) = -sjA-j\z)si - -trAr^\z). 
Next we list some results which will be frequently used below. 



Lemma 2. (Burkholder (1973)) Let {Yi} be a complex martingale difference 
sequence with respect to the increasing a-field {Ti}. Then for k > 2 

k / \ k/2 



E 



< MkE E(\Yi\^\ri-i)\ + MtE I^'I' 



Lemma 3. (Theorem 35. 12 of Billing sley ( 1995) ) Suppose for each n, Yn^i, l^n,2, 
■ ■ ■ , Yn^m 0, real martingale difference sequence with respect to the increasing 
a-field {J^nj} having second moments. If as n ^ oo 



where a"^ is a positive constant and e is an arbitrary positive number, then 

f^Y^,^NiO,a'). 

Lemma 4. (Lemma 2.7 in [4jj Let Y = (Yi, ■ • • ,Yp)'^ , where Yi's are i.i.d. 
real r.v.'s with mean and variance 1. Let B = {bij)pxp, a deterministic 
complex matrix. Then for any k >2, we have 

E\Y'^BY - trB\'' < MkiEY^HrBB*)''^^ + MkE{Yi)^Hr{BB*)^/^, 
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where B* denotes the complex conjugate transpose o/B. 

Lemma 5. Let C = {cij)pxp be a complex matrix with Cjj = and Y = 
(Yi, ■ ■ ■ , Yp)'^ , defined in Lemma^ Then for any k >2, 

(2.2) E\Y^CY\'' < Mk{E\Yi\'')\trCC*)''/^. 

Lemma [5] directly follows from the argument of Lemma A.l of [1]. 
A direct calculation indicates that the following equalities are true: 

E(sf Asi - trA)(sfBsi - trB) 

p 

(2.3) = {EX^^ - |^Xi\p - 2) ^ a,Ai + \EXl-^\Hr AB^ + tr AB; 

1=1 

p 

(2.4) £^[(sf Asi - trA)s[Br] = EX^^ ^ a^^ef Br, 

i=l 

where B = ibij)pxp and A = {aij)pxp are deterministic complex matrices and 
r is a deterministic vector. Here is the vector with the i-th element being 1 
and zero otherwise. 

In what follows, to facilitate the analysis in the subsequent subsections, we 
shall assume v = > 0. Note that Pj{z), Pf{z), (3ij{z), hi{z), 612 (-z) are 
bounded in absolute value by \z\/v ( see (3.4) of [3]). From fll.l3p we have 

(2.5) A-\z) - Aj\z) = A-\z){A,{z) - A{z))Aj\z) = -1a,(z)/3,(z), 
and from Lemma 2.10 of |,4J for any matrix B 

(2.6) \triA-^iz) - A-;^iz))B\ < H, 

J y 

where || ■ || denote the spectral norm of a matrix. Moreover, Section 4 in [4j 
shows that 

(2.7) n-''E\tr{A^\z) - Etr{A^\z)\'' = ©(n''^/^), k>2. 

One should note that (12.71) is still true when A^^{z) is replaced by A|f2^(z). 

To simplify the statements, assume that the spectral norms of B, Bj, Aj, C 
involved in the equalities fl2.8l) - fl2.16l) are all bounded above by a constant. For 
> 2, it follows from Lemma H and ([22]) that 

(2.8) n-^Els'^Bs, - trB]'' = 0{el'-^n-'), E^z)]" = 0(4^"^^), 
and that 

(2.9) n-^Els^BeieJCsil'^ 



< Mn~''[E\s^BeieJCsi - trBeieJC]^ + E\eJCBei\^] = 0{e 
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We shall establish the estimates (l230D -( l2J2l) below: 
(2.10) ^IsfBsil'^ = 0(n(t-2)£^-4), ^ > 4^ = Oin-^el^""), k>2, 



(2.11) 



E|sfBs2|'^ = 0(n'=-2£^^),fc>4 



and for m>0,g>l,0<r<2, 

m q 

(2.12) E n -sf A,si rr -{sJB.s^ - trB,)(sf C^si) 
J. J. ^ ±± fi 

i=i j=i 

One should note that fl2.10p and (12. lip also give the estimates for k = 2. For 



O(n-^£(f-2)V0). 



example 
(2.13) 



E\slBsi\^ < (E|s^Bsi 



0(1). 



In addition, from (12.81) and (12.111) we also conclude that 
(2.14) 

Eln'^sfBsisfCssI^ < ME|n-i(sfBsi-trB)sfCs2|^+ME|sfCs2|^ = 0{n^/^). 



Consider fl2J0D first. Note that for A; > 4 



(2.15) E\slsi\'' < 



M 



n 



2k 



n^«2,ii>l,i2>l 



11^12 I 



i=2 



0(1). 



Applying Lemma [2] twice to the second expectation in (I2.15P gives 

n n n 

E\J2sJs,\' < ME\ ^(sfs, - E{sfs,)t + M| ^E(sfs,)|^ 

k/2 



i=2 



i=2 



i=2 



< M[J2EisJs,-E{sfs,)f] +MY,E\sJs,-E{sJsi)\^ + Mn^^ 



J=2 



i=2 



< Mn' + Mn[(^ E{Xl^ - iff^ + ^ E\Xl^ Mn"" 



m=l 



m=l 



The third expectation in (12.150 can be estimated by using Lemma [2] three 
times, 



^1 -n-*2 
ii7^«2,n>l,«2>l 



ii>l «2>l,n7^«2 



T 

^ii^«2 



i=3 



< Mn'^E|X^E[(s^s,)2|a 



1^/2 



i-1 



i=3 



j=3 
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where Qi = cr(s2, ■ ■ ■ , Sj). It follows from (12.151) that for k > 4 

(2.16) E|sfBsi|'^ = E||sfBsif < E(||sf ||||B||||||si||)'^ < ME|sfsi|*^ < M, 

where || ■ || denotes the spectral norm of a matrix. This, together with Lemma 
m ensures that for > 4 

k 

2 



ElsfBsil'^ = E|sfBsisfB*Si| 

< ME|sfBsisfB*Si - sfBB*Si|t + ME|sfBB*si 



< [Mn^-^e''^-^ + M]E|sfB*Bsi|t + M 



2,fe-4 



which gives (I2.10p as well as the order of E\ai{z)\'^. 

Second, consider (12. lip . Let y = (yi, ■ ■ ■ ,yp)^ = Bs2 and then by lemma [2] 
and dH]), for k > 4, 

E\s^y\' < ME{Y,\ym\')'^' + MY,E\Xmi\'E\y^\'' 



m=l 



m=l 



< ME\y*y\''/^ + Mn^~h^^-^E\y*y\''/^ 

< (M + Mnt-25^-4)E|s^B*Bs2 - trB*B\''/^ + Mn^^'^ + Mn^-^e^-^ 
(2.17) = 0{n'~\i-'), 

where we also use the fact that for k > 4 



\2\k/2 



As for (2113), if m = and r = 0, then flZT^ directly follows from ([23]) and 
the Holder inequality. If m > 1 and r = 0, then by induction on m we have 



E 



< E 



m ^ 1 

TT -sf A,si TT -(sfB.Si - trBj) 
i=i j=i 

m-l ^ ^ ^ ^ 

Y[ -sf AiSi-(sf A^si - trA„) JJ -(sf B^Si - trBj 

m-l ^ g ^ 



pM 
+—E 

n 



i=l 



O(n-54'?-2)v0). 
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E 



m ^ 1 Y 



O(^-l,(2.-4)V0)^ 



(m = by (12. 8p and m > 1 by induction). Thus, for the case m > 1 and 
> 1) by ( 12.101) we obtain 



E 



W -sf AiSi TT -(sfB.Si - trB,)(sfCiSi) 

1.1. yi n 

i=l j=l 



9 



n-s]^ AiSi 17 - (sf B, Si - trB 
n n 
i=i j=i 



O(n-5£(f-2)v0). 



When m = and r > 1, fl2.12p can be obtained similarly. Thus we have proved 



2.2. The simplification of Mn\z). Define the cr-field J-'j = (t(si, ■ ■ ■ ,Sj), 
and let Ej{-) = E{-\J-'j) and -Eo(') be the unconditional expectation. Now write 



(2.18) 
where 



v^^Ej(s^A~^(^)s) - Ej^i{s'^A-\z)s) 

n 

v^^E,(s^A-i(z)s - sjATi(^)s,) 

-E,^i(s^A-i(^)s-sjATi(^)s,) 

n 



a„i = (s-Sj)^A ^(z)s, a„2 = sJ(A ^(2;) - A^. ^(z))s, a^g = sjA^. ^(2;)(s - s^). 

The above first two terms will be further simplified one by one below. One 
should note that Mn\z) is now a sum of martingale difference sequences. 

First, splitting A'^{z) into the sum of A~^{z) — Aj^{z) and A~^{z) and 
splitting s into the sum of Sj and Sj/n, we have 



(2.19) 



^ _ ^(1) I ^(2) , „(3) , ^(4) 
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where 



and 



Using 

(2.20) (3,{z) = (3f{z) - (3,{z)(3f{z)^,{z), 

we have 

(E, - E,^i){aS) = (Ej - E,_,)[^^{sjAj\z)s,rpf{z)] - 
= {E, - E,_^)[^^]{z)f3f{z)] + {E, - E,^^)[^^^,{z)(3f{z)trAj\z)] - 

where = {Ej - Ej^i)^{sjA-\z)sjf(3j{z)/3f{z)-fj{z). This, together with 
(KV2\i . shows that 

n n 

i=i i=i 

< ME|7i + ME|7i(z)P + Mi?|7i(z)^(sf Ar^(z)si)T = 
which gives 

n 

i=i 

By (12. 8p it is a simple matter to verify that 

n 

v/^E(E,-E,_i)(«S)^0. 
i=i 

Appeahng to (12.121) we have 



n 

E\ Y.^E, - E,^,)^,{z)-=s^^A^\z)-s,Pf 
j=l V 



^*-(z)|2 = 0(n-i/2) 



and 



E|v^X^(E, - E,^,)^sjA,{zrsMzMz)(3f{z)\' = 0{n-"% 
which, together with (12.201) . leads to 

n n ^ 

v/^E(E, - i?,_i)(aS) = - E E,[(l - /5f (^))-=sjA7i(^)s,] + o,(l). 
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This ensures that 

n n ^ 

v/^^(i?,-i?,_0(a„i) = 5^i?,(/3f(z)-=sjA-i(^)s,) + o,(l) 



Op(l), 



Jn 

i=i i=i 

n 

(2.21) = -zm{z)Y,E,{^s';A-\z)-Si) + 

j = l V 

because, by (2.17) in [5], ([22D and (|2A0|) . 

(2.22) E\{f3f{z)+zm{z))sjA-\z)s,\' = o(l). 

Secondly, sphtting s into the sum of Sj and Sj/n further gives 
«n2 = -^sjAj{z)sjf3j{z) - hjAj{z)Sj(3j{z) 
and thus, as in treating a^^f*, we have 

n n ^ 

V^Y.^E, - £;,-i)(a„2) = - Y.^E, - E,^{)[{1 - f3f{z)) y=sjAj'i 

--/^ - E,-i)[sjA,{z)s,Pfiz)] + 0,(1) 

j=i 

= -(1 + 2;m(2;)) XI Ej{^sjAj\z)sj) + zm{z) ^ v^E,(aj(2;)) + Op(l), 

where in the last step we also use the estimate 

E\{Pf{z) + zmiz))ajiz)\' = E[Ei\iPfiz) + zm(^))a,(z)| V(s„ t ^ j))] 

= E[\PfXz) + zm(^)pE(|a,(z)| V(s„ ^ ^ j))] = o{n-^) 
which is from (2.17) in ^Sj, (EZD and fICTil) . 

Consequently, for finite dimension convergence, we need consider only the 



Z)^j\ 



sum 



(2.23) Xa.5^r,(z.) = 5^5^a,r,(^,), 

1=1 j=i j=i 1=1 

where 



-2zm(2;)£'j(^sJ'A . ^(^)sj) + zm{z)y/nEj{aj{z)). 



Recalling T)j{z) = A - ^{z)sjsjA- ^{z) write 



a 



^{z)=af\z)+af{z) + af\z), 
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I V 

h^l 



= ^ EerD,(z)e,[X,V(|X,,| < \ogn) - EXll{\Xn,\ < \ogn)] 



h=l 



and 



"f^(^) = ^Ee^D,(z)e,[X,y(|X,,| > logn) -EX,y(|X,,| > \ogn)]. 



h=l 



Lemma [5] and fl2:T6D show that E\af{z)\^ = 0{n-^). Lemma [2] and fl216|) 
give = 0{n^'^{\ogn)'^) because 

n n 

^ |erA,(^)e,|'= < \Y,elA-\z)-sfsjA-\z)e,\' = {sj A-\-z)A-\z)-s,)\ 

j=l 3=1 

where A; = 2 or 4 and Aj^(z) denotes the complex conjugate of A~^(z). Since 
EXfJ{\Xn\ > logn) we have E\a^^\z)\^ = o{n-^ ). Therefore we obtain 



i=l 



n 4 

2 §EE^ 



=1 



I{\J2a.Y,{z.)\>e) 

r 

I{\Y,a.Yl'\z,)\>e/4) 



i=l 



j=l h=2 



1=1 



4E^ 

i=i 



i=l 



where 1"/''^^) = zm{z)y/fiEj{a'j''> {z)), /i = 1, 2, 3 and = -2zm{z) x 

(^sjA-^(^)Sj). Here we also use E\Yj^\z)\'^ = 0{n-^) by (l210D . Thus the 
condition (ii) of Lemma [3] is satisfied. Hence, the next task is to find, for 
Zi,Z2 G C\M, the limit in probability of 



(4)/ 



(2.24) 



J2E,-iiY,iz,)Y,iz,)). 
i=i 
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To this end, it is enough to find the hmits in probabihty for the following: 

n 

(2.25) i E E,^,{E,{s]A^\z,)-s,)E,{s]A-T\z,)s,)i 

n 

(2.26) E E,_,[E,{s^ A-^\z,)-s,)E,{a,{z2))l 

(2.27) n E Ej_^[Ej{aj{z^))Ej{aj{z2))]. 

The hmits of (E2n]), fl^^ and finally flZ^ will be determined in the 

subsequent subsections. 

2.3. The limit of (I2.25p . Introduce Aj^(z) and s^. like A~^{z) and Sj, re- 
spectively, but A~^{z) and s^- are now defined by Si, ■ ■ ■ , Sj_i, s^^^^^, ■ ■ ■ ,s„ 
instead of Si, • ■ ■ , Sj_i, Sj+i, ■ ■ ■ , s„. Here {Sj_|_i, ■ ■ ■ , s„} are i.i.d copies of Si 
and independent of {sj, j = 1, ■ ■ ■ ,n}. Therefore fl2.25l) is equal to 

^ n 1 " 

-Y,tr[E,{A-T\z,)-s,)E,{^A~\z,))] = -Y,E,^^ ^]\^2)^]\^i%]. 

n 

Applying Sj = ^ E ^'^d fll.lSp further gives 

1 " 

(2.28) E,[sjAT^(z2)A-i(zi)s,] = -5^i?,[A,(^2)sfA-.i(^2)ATi(z0i,]. 

The next aim is to replace Pij(z2) in the equality above by /3*J(z2)- To this 
end, consider the case i > j first. By (12.121) 

(2.29) E\EAm^2)-f3l^{z2))sfAT^\z2)Aj\z^)-s^]\=0{n~'/'). 

Second, when i < j, break Aj-^^zi) into the sum of Alj^{zi) and Aj^{zi) — 
Ai/i^i), Ej into the sum of s^^- and s^- — s^^-, where Aij{zi) = Aj{zi) — n^^Sisf 
and = s_j — Sj/n. Then, when i < j, with notation 

we have 

(2.30) E,[{f3i,{z2) - f3l!j{z2))sjAT^\z2)Aj\zi)sj] = C„i + C„2 + C„3 + C„4, 
where 

C„l = E,m,{z2) - Pt^{z2))sjAT^\z2)X^\z,%^], 

Cn2 = -i?,[(A,(^2) -/35(^2))sfAr;(z2)Ar.i(zi)s,], 



16 



GUANGMING PAN, WANG ZHOU 



Cn3 = --E,[{f3ij{z2) - (3l;;{z2))sjA,/{z2)Ai/izi)sisfA,j\zi^ 

it 



and 



= -^^j[(Ai(^2) -/54'(2:2))sfA./(2;2)A,/(2;i)sisfA,/(2;i)^^.(2;i)s^ 



It follows from (^A2h that E\cnj\ < Mn-^/^,j = 1,2,3,4. Moreover, note that 
EjlPjj {z2)sf A~j^ {z2)Aj^ {zi)Sj] = when i > j. In what follows we use the 
notation 0l^(1) to denote convergence to zero in Li. This, together with fl2.29p 
and fl2.30p . implies that 



n 

EAsJA;^\z2)Aj\z,)s^] = -J2EAPSiz2)sjAT^\z2)A-\z,)s^]+o,Al) 

= IJ^EM-{^2)sJAt^{z2)Aj\z,)-sA + o,,(l) 

i<j 

= dnl + dn2 + dn3 + 0L:,{1), 
= ^J2^Mji^2)sjAT^\z2)X^\z,)s,P iz,)l 

ft 

i<j 

= ^Xl^i[^?(^2)sfA,^-'(z2)A,r.i(2;i)s,^.] 



(2.31) 
where 



and 



= -^5^i?,[/5j(^2)sfAr;(^2)A-.i(^0s.sfA-.i(z04X^i)i.^^ 



i<j 

Here in the last step we apply = Sj/n + s-^ first, then use fll.l3p and finally 
split A~^{zi) into two parts as before. 

We claim that the terms dn2 and dn3 are both negligible. To see this, we 
first prove the following estimate 

2 



(2.32) 



E 



^E^^^^^'(^2)A,r.i(zi)s,^. 

i<j 



0(1). 



Indeed, the left side of fl2.32p may be expanded as 

(2-33) ^ ^(<ArJ(.2)ArJ(^0in,<ArJ(^,)A,rJ(^-0i,^^.)- 

h<j, i2<j 

From fl2.10p . the above term corresponding to ii = 12 is bounded by 



r=o(i). 

' n 
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To treat the case ii ^ 12, we need to further spht A-J(22) as the sum of 



^iXM^) and P^i,]{z2) - A^Xi{z2), where Ai^i^j{z2) = Ai^j{z2) 



Moreover, both Ai^j{zi) and s^^^- are also needed to be similarly split. To 
simplify notation, define 



13. . {z) 

—1-1123 



1 + ^S^Ani2j(^)^»: 



and 
A 



Ai,j{z) 



T - 



n 



t2] - s^AjJ(z2)AjJ(zi)Sj2j-. 



By fl2J0D . (1211]) and flCTD we have 



-\E {slAl]{z2)Al]{z,)s,,C^23) 

1 



< 

+ 

< 



n 
M 

n 
M 

■n? 
M 

n 



E(s^Ari(^2)Ari^^.(^i)^,^,,/^i)s.20 

E {^l KI23 )Al\M^ {Zi ) 0: 

E (si Ar^l^.{z2)si2slArl^j{z2)Pi,i,j {z2)ArXj (^i)/?.^ (^Osi^Oai) 



M 



+ — (E|s^A-J^/z2)s.2S^A-i,.(z2)Ari^,.(z0s./i?|02,f)'/' 



«2 12 ili2j 



■1\12J ' 



n 
M 



(^^AnLi(^2)Si2S^/5i,i2j (2:2) A-^ .2^.(^2) Aj^-2j-(2:i)s.^ I 



< -(i5;|sjArj^^.(^,)s,J^E|sjA-,i^/z2)ArJ^^.(.Ol,,/)'^'(^l02^^ 



1 

n 
M 



^ (^n (2:2) A, J^^. (2:1) s,, sf^^.^ (2:1 )A,Xj {zi )h,i23Ci2j 



< -{E\slATl^{z2)A-XAzM2\^^^^^ 



n 



5«2J I 
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n 



123 '■2"l2r^m2J \~^J^^lil2J 

^AiXj(^'^)^i2^Z—iXj(^'^)fli^i,j(^^)^ili2j^i^^ 
M 

n 



x{E\Q,,\Y' = 0{n--'/'), 
The above four estimates, together with the fact that 

E{slA-Xj{z2)A-Xj{zi) X gi^i^jCi.j^ = 0,ii ^ i2, 

imply that all terms in fl2.33p corresponding to ii ^ 12 are bounded in absolute 
value by Mn~^/^ ^ which ensures (12.321) . 

Consider the term dn2 now. In view of (12. 7p and (I2.12p we may substitute 
bi2{.Z2) for Pij{z2) in the term dn2 first and then applying (I2.32p we conclude 
that -E|(i„2| = 0(1). As for the term dns, it follows from (12.71) and (I2.12p that 
/3lj{z2), /3..{zi) and sf Alj^{z2)Alj^{zi)si can be replaced by &i2(-22),^i2(-2i) and 

HrA~j^{z2)A^j^{zi), respectively, where 

1 



1 + '-EtrA^,\zy 

(note: b^2i^) ~ ^12 (-2))- Moreover, by an inequality similar to (12.61) we have 

1 

n 



\E,[sjAT^\z^%^- {trAT^\z2)^\z^) -trAj\z2)Aj\z,))] 
< M- 



Ej\sfAi/{zi)s, 



n 



Therefore from (I2.10p we obtain 

^12(2:2)^12(^1 



d. 



n3 



E,[trAj\z2)Aj\z,)Y,sJ^\z,%^] + 0^,(1). 



i<j 



As in (I2.32P we may prove that (even simpler) 



(2.34) 



E 



which then implies that -Elcinsl = o{l). 
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As for dni, we conclude from (ETD, (12A2D and (EJD that 

= ^lii£?M£l)(, _ l)E,(trA7^(z,))E,(A-^(.0) + o..(l). 

Summarizing the above, we have thus proved that 
E,{sjA-\z,))E,{Aj\z,)-s,) 



9 



-bi2{z2)buizi)Ej{trAj\z2))E,{Aj\zi)) + ol,(1) 



(2.35) = ^2;i2;2Zn(^i)zn(^2)^i(trATi(^2))^,(A7i(2;i)) + 0^,(1), 

using the fact that, by (2.17) in [5J and (12. 6p . 

(2.36) bi2{z) -zm{z). 

2.4. The limit of (12.261) . We first present a lemma below, which is necessary 
for finding the limit of f l2.26p . for the next subsection and Section 3. 

Lemma 6. Under the assumptions of TheoremUi as n ^ oo, 

(2.37) max ^/E\E{eJA:[\z)sl) \ 0. 

i 

Proof. We first prove that for i ^ j, sup ^/n\E{ejA^^(z)e,i)\ — 0. To this end, 
write 



m=2 



Miz)+zi=^Y: 

Multiplying by A|f ^(2;) from the right on both sides of the above equality gives 

1 " 

I + zA^\z) = - V s^s'^A^\{z)p^i{z). 



n 

m=2 



Using 

(2.38) /3™i(z) = buiz) - (3miiz)bi2iz)Uiiz) 

we obtain 
(2.39) 

I + zA^ [z) = SmSj^A i[z) 'V'^ SjjiS A i{z) j3ml{z)^ml{z) ■ 

m=2 m=2 
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It follows that for i ^ j 



/ N n n 



(2.40) 2v^E(e[A^^(2)e, 
n \ 

m=2 m=2 

where we also uses (12.91) and the fact that, as in (12. 8p . by Lemma H] and (12.71) . 
(2.41) E\^,,{z)\'^ = 0{el'~''n~'), k>2. 

Here and in what follows (in this lemma) 0(n~^/^) and other bounds are 
independent of i and j. 

We conclude from (12. 9p that 

T . 



n 



h2{z)V^E{ejA^\z)ei) + 0{n 



For the second term in (I2.40p . first, by a martingale method similar to (I2.18P 
and (12. 9p we have, for e/ = or e^. 



E\efA2l{zi)ej - E{ef A^^{zi)ej 

n 

E\ Y^{E^ - Ern^,)[ef{A,l{z,) - A;;^,,{z,))e,]\' 



m=3 

M " 

(2.42) < - J]i5|s^A-k(.i)e,efA-k(^i)s™r = 0(n-i), 

m=6 

This and (12. 7p ensure that 

\^E[ejA^l{z)e,{trA,l{z) - EtrA,l{z))]\ 

= \-E[{ejA^liz)e, - EeJ A^I{z)e,){trA,l{z) - EtrA^I{zm 

< -{E\ejA^,\z)e, - EejA^,\z)e,\'E\trA^liz) - EtrA^liz)]^/' < -. 
Second, appealing to (12. 3p gives 

E{e]s2slA^l{z)ea2i{z)) = E{slA^I{z)eieJs2 - ej A^l{z)ei)-f2{z)) 

-EiejA^,\z)e,ejA^,\z)e,) + -E{eJ A^,'iz)e,). 



n ' ' n 
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It follows that 

= v^E(eJs2S^A2-/(2;)e,72i(2;)) + v^E[ejA2/(z)ei-(trA2i'(2;) -EtrA2/(2;))] 

On the other hand, in view of (12.91) and (12.411) we obtain 

Therefore, by (I2.38P we find 

yJnE{eJs2s'^A^^{z)f32i{z)^2i{z)e,) 

= V^buiz) ^E{eJs2slA^,\z)eiUiz)) + E{eJs2slA^\z)eif32iiz)e2iiz)) 

= 0{en). 

Therefore, combining the above argument with (I2.36p . we have 
(2.43) sup \V^E{ejA^\z)e,)\ ^ 0. 

Next, applying (12.381) two times gives 

E{eJA^\z,)s^) = -J^ EieJ A;^\{z^)s^P^mliz^)) 

= - \ - E{ejA-,l{z,)s2i2i{zi)) + E{ejA-,l{z,)s2^2i{zi)e2i{zi)) 

n L 

Obviously, we conclude from (I2.4ip . (I2.9p and Holder's inequality that 

\^E {e^A-,^{z,)s2^2i{zi)e2i{zi)) I = 0{n-'l\^), 

while (EH), ([21]) and fl2:i3|) yield 
, n — 1 



max I E{e.^ A^-^ (21)8261(^1))! 

t n 



max 



EXUn 1) ^^[,TA-i(,^)e^.(A,-i(.0),,]| 
^ i=i 

t^maxf^|E[efAri(.i)e,(Ar^(.i)),,]| + - 

< M\EX^.E-trA-7^izi)\ma.-x\EiejA-{^izi)e.)\ + — 
n i^j n 



< 



o[n 



-l/2y 
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Here we also use the estimate, via (12.71) and f l2.42p 
Thus the proof of (12.371) is complete. 

□ 

Consider (I2.26P now. First, f l2.4p indicates that 

T^X^ " ^ 

(2.44) mB = ^$^$^[i^;,(D,(^2))].ai?,(efAT^(^0s.)]• 

"' j=i i=i 

Next we shall prove that ej Aj-^ {zi)sj above may be replaced by E{efAj^{zi)sj). 
Using martingale decompositions as in (12.181) and the fact that ej Aj-^ (z)sj = 
sjAj^{z)ei, we obtain that 

sJAJ\z2)eiEj[eij{z^)] 
= [sjAj\z,)e, - E{sjAj\z,)e,)]E,[e.,iz,)] + EisJ AJ\z,)e,)EA9^J{z^)] 

gnm2{z2) X Ej [gnmAzi)] + "^(^J^J 

where 



9nm2 {z2) X Ej [gnm^{zi)] + E(s[A • ^{z2)ei)Ej [gnmAzi)] 



n 

9nm{z) = " ) (%m (2) ) , Oij{z) = eJ A-\z)sj - E{eJ Aj\z)Sj) 

and 



dij^{z) = ejA. \z)sj-ejA.^{z)sj^ 



^2 ^« ^jmiz^)^'rn^m-^jmi^) (^rnj{z)Sr, 



■^jmiz)^rn^m-^imi^)(^rnjiz)Sjm + Gj A-^(z)Sm 

Here one should notice that 6ij{z) and gnm.{z) are the same. 

As in (I2.17p . one can verify that 
(2.45) 

Eln-^ef AT^(;.)s„|'= = 0{n-'), k = 2 or 4, E\n-'eJ Aj^{z)sJ' = 0{n''). 
Thus, for A; = 2 or 4, via (|210D . 



E\ Aj^{z)smS^Aj^{z)sjm\ — 0{n ) 

and, via fl^ . 



These yield that E|%^(;z)|2 = 0(^-2), E|%„(;z)|^ = Oipr'^En) and then 
(2.46) E\g^m[.z)f = 0{n-^), E\g^^{z)f = Oin-^e,^). 
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Therefore 

(2.47) [Ej^\[E,{T^,{z,))],,E,{e,,{z,))\f 

i=l 

i=l i=l 

1=1 i=l 

Here by (l216|) 

J2\E{sjAj\z,)e,)mg^,^,{z,)\' < -J2\^{sjAj\z,)e,)\' 

i=l 1=1 

< -EisjAj\z,)Aj\-z,)-s,) < -. 
Thus, ef A7^(^i)s j may be replaced by E(efAj ^(zi)sj), as expected. 
In addition, by fl2:T6D and fl2:37ll 

Ej2\[EA^A^2))]uE{ejA-\z,)s,)\ 

i=l 

< i5;X^[E,(ATi(z,)s,sjATi(^2))]d^(efATi(^Os.)l 

i=l 

(2.48) < m^x\E{ejA^\zi)s,)\E{sjAj\z2)Aj\z2)s,)^0. 
It follows from fICTD and (12:481) that 

(2.49) Ej^ \[E,iB,iz,))]uE,iejAj\z,)s,)\ ^ 0, 

i=l 

which then ensures that (12.261) converges to zero in probability. 

2.5. The limit of (127271) . O shows that (12:271) is equal to 
(2.50) 

j=i 1=1 j=i 

As we shall see, the above first term converges to zero in probability and the 
second term has a close connection with (12.250 . 
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Consider the second term of f l2.50p first. Write 

(2.51) = E, [sjAj\z^)Aj\z2)s^sjAj\z2)E, {Aj\z,)s,)] + /„, 
where 

U = ^P^\z^^\z^s^^\z^ {A-\z^)-s, - E,{Ar\z,)-s,))] . 

We claim that 

(2.52) E\Q = o{l). 

To see this, let E_^j = -E'(-|si, ■ ■ ■ ,Si,Sj^-^^, ■ ■ ■ ,s^). Then, recalling the defini- 
tions of A~^(z) and Sj we have 

sjAj\z,) {Aj\z,)s, - E,,{Aj\z,)s,)) 

n 

= E WA-\z2)Aj\z,rs,] [sjA-\z,)Aj\z,)-s,] 
i=j+i 

n 

= E - ^(-D.) [^]A]\z2)A.\z,)-s, - -s]A-\z,)A-\z,)-s,,] 
i=j+i 

= fnl + fn2 



where 



/nl = - E (^^J-^i^.ly) [sj Aj\z,) AT^\z,)sAA^,)] 



n 
i=j+i 



and 



1 " 

^"2 = --Yl (^ij- WAj\z2)A-/{zi)sisjA;j'{zi)s,,Pij{zi)] . 

i=j+l 

Note that is independent of Sj for i > j. Then applying fl2.10p yields 

E\U' < ^ E E\sjAj\z,)AT^\zM' = 0(1) 
i=j+i 
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and 

M " 
i=j+l 

M 



i= 
1, 



i=j+i 



= 0{- , 
n 

which ensures that 

So (12.521) follows from the above estimate and 

E\sjAj\z,)Aj\z2)s^\' = 0{l), 

which may be obtained immediately by checking the argument of (12.161) . 
As in (I2.52P we may also prove that 



E 



'-s';A-\z,)A]\z2% (sJAt1(^2) 

(2.53) -E,{s^A.\z,)))E,{A'^\z{)-s,)\ | = o(l). 
Therefore, combining (l^3T]) . (1^32]) . (1^3^ with ([MSD we have 

trE,(D,(zi))E,(D,(z2) 
= E, [sfA-i(^0A-^(^2)s,-i5,(ljATi(^2))i^;,(ATi(^i)s,)] +oz.,(l) 
= E,(sjATi(^i))E,<ATi(^2)s,0i5,(sjATi(^2))i?,(ATi(^i)s,) 

(2.54) = ^:^^^2^2V(^i)m'(^2)[i^^,(trATi(;,2))E^.(A7i(zi))]' + 0,^,(1). 

77/ 

We now turn to the first term in (I2.50p and claim that 

n p 

(2.55) _^^i^^.(D,.(^^))^^i^^.(D,.(^,))^^ ^0. 

^ j=i 1=1 

Indeed, recalling that 9ij{z) = ej Aj-^ (z)sj — E{ef A~'^{z)sj), we have 
p 

E\Y,Ej{B,{z2))nEj {eijizi)sjAj\z^)e,) \ < 
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P P 

i=l i=l 

The second term above is not greater than 

p 

max \E{sjAj\zi)e,)\J2E\E^ir>^{z2))uE,{ei,{z,))\, 

i=l 

which converges to zero by (12.47^ and (]2.37p . On the other hand, by (12.16^ 
and ^IMtf 

{j2E\E,iBj{z,)hEMA^,)r\r < x:i^i(D,(^2))..rEi^^i%(^i)r 

1=1 i=l i=l 

< EiJ2'^jAj\-z,)e,ejAj\z^)s,)yj2E\9nrnizi)\' = 0{e^). 

i=l i=l 

Moreover, it follows from Lemma [H] and fl2.49p that 
p 

E\Y,E,{'D,{z^))..E{ejA-^\zr)-s,)E, (sjA-i(^i)e,) | 

i=l 

P 

< max\E{ejA^\z,)si)\J2E\Ej(Pj{z2))nEj {sjA-\zi)e,) \ ^ 0. 

1=1 

Consequently, the proof of fl2.55p is complete. 
2.6. The limit of (|2:24|) . Note that 

trE,(A^. {z,))E,iA^ {z,))[l- (l + mj.0)(l+zn.(^2))^ 

where E\ln\ < M^fn (see (2.18) in [5]). Obviously, ELni^) ~^ m{z). This 
implies that 

(j - l)ziZ2m{zi)m{z2) 



n 



2 



-f-Bi(A-i(22))-Bi(AT>(zi)) 



which, together with (12.351) and (12.541) . leads to 

4«r[Bj(A-i(.-i)%)£j(sjA-'(.-2))l + 2irB,(D,(2i))-Bi(Dj(22)) 
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n J J 
-2 + 2z^Z2{l +m{zi)) {l+m,{z2)) 

Further, we conclude from (12.561) that 
1 " 

-J2[trE,{A~\z,))E,{Aj\z,))r 

1 1 ^ 1 



1 2V i;; V T _V ^)) „2 (l+m(zi))(l+m(^2))'' 

i.p. 1 /"^ (ix 

' z'^z'iil + m(;zi))2(l + mfzz))^ in fl - x '^iiiC^iM^a) n2 

1 

2:12:2(1 +ZZl(-2i))(l +I?l(-22))[(1 + m.{z2)) - cm{zi)m{z2)\ 
It follows that 

1 " 

dlMD = ziZ2m{z^)m{z2)-Y^ [4tr[E,(ATi(^i)s,)E,(sjATi(^2))] 



(2.57) 



+2trEj{Ti,{zi))E^{Ti,{z2))\ + Op(l) 
2c2;i Z2rrf' ( Zi ) ( 2:2 ) 



(1 + m(zi))(l + m(-22)) - cm(zi)m(z2)' 



3. Tightness of M,1^^(2;) and Convergence of Mn\z) 

First, we proceed to prove the tightness of Mn\z) for z E C, which is a 
truncated version of Mn{z) as in (11.91) . By (I2.10p we have 

m n n ni 

i=l j=l j=l i=l 

which ensures that Condition (i) of Theorem 12.3 of [6] is satisfied, as pointed 
out in [5]. Here Yj{z) is defined in (I2.23p . Condition (ii) of Theorem 12.3 of [6J 
will be verified if the following holds, 

\zi - Z2r 
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In the sequel, since and are symmetric we shall prove the above inequal- 
ity on C+ only. Throughout this section, all bounds including O(-) and o(-) 
expressions hold uniformly for z E C^. 

In view of our truncation steps, (1.9a) and (1.9b) in [5] apply to our case as 
well. That is, for any r/i > (1 + ^/cY , < 772 < /(O, l)(c)(l - ^/cY and any 
positive I 

(3.1) P(||S|| >r/i) =o(n-'), P < ^2) = o{n-') 

Note that when either z E Cu 01 z E Ci and m/ < 0, || Aj"'^(2;)|| is bounded in n. 
But this is not the case for z G C or z G Ci and Ui > 0. In general, for z G C^, 
we have 

(3.2) ||A7^(^)|| <M + v~^I{\\A,\\ > K or A„,„(Aj) < hi). 

Here A^- = S - s^sj, hr G ((1 + ^A5)^, Ur) and hi G (m/, (1 - v^)^). 
As in Section 2.1, now write 

m!,'\zi) - m!,'\z2) 

Zl - ^2 

n 

(3.3) = V^Y.^E, ~ E,_^)[s^A-\z^)A-\z2)s~sjAj\z,)Aj\z2)s^]. 

Moreover, expanding the above difference we get 

s'^A~^{zi)A'^{z2)s - sjAj^{zi)Aj^{z2)sj = g„i + g„2 + to, 

where 

qni = {s^-sJ)A~\z^)A-\z2)s, g„2 = sj {A-\z,)A-\z2)-A-\z,)A-\z2))s, 
and 

g„3 = sjAj\zi)Aj\z2)is - Sj). 
It follows from ([H]), (IXTOj) . Q and ([3ll]) that 

n 1 " 

E|v^^(E,-E,_0toP<-E^I^JV(^l)V(^2)s,f 

i=i ^ i=i 

< M + nV;'P(||Ai|| > /i, or \min{A,) < hi) < M, 

where we use, on the event (||Aj|| > hr or Amj„(Aj) < hi), 
(3.4) 

\sjA-\z,)A-\z2)s,\ < ||s,||i|s,||||A-^(^i)A7^(^2)|| < Mv'V < n'p-\ 
by (Q. 
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For qn2i expanding its difference term by term we have 



where 



_ (1) I I (6) 

Qn2 — (ln2 + T g„2 i 



^"2 = PAzi)Pji.Z2)^3{zi)Aj{z2)Sj, q\i = --sJ(3j{zi)Aj{zi)Aj\z2)Sj, 



Qui = l3j{z2)A-^{Zi)kj{z2)Sj, = ^Sf Pj{Zi)Pj{z2) A j{Zi) A j{z2)Sj, 

and 



= -^sJ/5j(^i)A,(2i)Aj. \z2)sj, qfl = -^sJf3j{z2)A^ \zi)Aj{z2)sj. 
We conclude from ([2l]), (|210D . (ISTTj) . Q and ([331) that 

n 

E|v^ -E,_OgSr < M + V-VP{\\S\\ > K or XrmniAi) < hi) < M. 

i=i 

where we use, on the event (||S|| > hr or Amm(Ai) < hi), 

(3.5) \pj{z)\ = |1 - n-^sjA-^(z)Sj-| < 1 + n-'^v-^\\s^f < My-^n, 

by (12.51) . Obviously, this argument also works for qn2,j = 2, ■ ■ ■ ,6. Moreover, 
we may split g„i further and apply the above argument to conclude that 

n 

E\^^{Ej - Ej^i)qni? < M. 
i=i 

Here the details are skipped. 

Next, consider M„ {z). By s = n ^ Sj, (11.131) and an equality similar to 

1=1 

(12:38|) we obtain 

1 " 

^E{s^ A-\z)-s) = ^Y.^{msjAT\z)-s) 

* 1=1 

^ J]E(A(^)sf Ari(z)s,) + ^$^i?(A(^)sf Ari(z)s,) 



i=\ i=l 

b (z) " 

^ E{trAi\z)) + tnl + tn2, 

i=l 



-Hz)s,, 
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where 

7 / \ n 
i=l 

Again, using an equality similar to (12.381) gives 

f _ fW , /2) _ (1) (2) 

where 

4¥ = -^i:i^te(^)sfAri(.)s.),tS = ^^j2Emzmz)sjA 

* 1=1 * 1=1 

and 

i=l i=l 

Note that |&i(2;)| < M for z E Cn (see three lines below (3.6) in [5J). It 
follows from ([22]), (EJ]), CTID . (1331) . (13:21) and (ES]) that 

< Me, + Mn^V;'^(l|S|| > K or A™„(Ai) < /i^) < M£„, 
because \Pi{z)^f{z)sJ A~'^{z)si\ < n^f""^ on the event (||S|| > hr oi Amj„(Ai) < 

hi). This argument clearly applies to t^^2 well, and so \t^^2 \ — Msn- (12. 4p 
shows that 

\€\ = I _ f;E(e^Ar^(z)e,„e^Ar^(z)sO| 

* m=l 



m=l 



< M\bl{z)EXl^-Etr{A^\z))\maxV^\E{elA^\z)si)\ + o(l) 

= 0(1), 

where we make use of the facts that by (12.371) . (13. ip and (13. 2p . 

|maxv^|E(e^A^^(2;)si)| = o(l), 

m 

and that by (121^21) . (ElEl), (El]) and (I32]), 

E|(e^A-i(z)e„ - E(e^A-i(^)e„))(e^A-i(z)si - E{elA-\z)-s,))\ 
< Mn-^ +Av~^nP{\\Ai\\ > hr or A„^i„(Ai) < hi) = 0(n"^). 
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Note that E{ii{z)sJ A-\z)si) = E-ff{z)+n-^E{trAr\z)-EtrAr\z)f and 
then applying ([22]), (123]), dHl]) and ([32]) gives = Oin^^^"^). 

Summarizing the above we obtain 

./EE{s^A-\z)s) = ^^E{trAY\z)) + o{l). 

Moreover, it is proven in Section 4 of [5j that n{EtrA~^{z)/n — CnTriniz)) is 
bounded for z G C„. In addition, by (12. 6|) . (13. 1|) and (13. 2p we have 

EtrA^^iz) EtrA~^{z), M 
n n Jn 



It follows that n{EtrAi ^{z)/n — Cnmn{z)) is bounded. This, together with the 
boundedness of shows that 

sup ^{Es^A-\z)-s - ^ 0. 

zeCn 1 + c„m„(2;) 



4. The proofs of Lemma [T], Theorem [T] and Theorem [2] 

Proof of Lemma [T] To finish Lemma [T], s^s — c„ needs to be written as a sum 
of martingale difference sequence so that we can get a central limit theorem 
for s^s — Cni and, more importantly, obtain the asymptotic covariance between 
s-^s — Cn and s-^A~^(2;)s. 

Thus write 

n n 

^/n{s^s - Cn) = ^/n'^{Ej - i?j_i)(s'^s) = ^/n^{Ej - i?j_i)(s^s - sjsj) 

j=l 3=1 

(4.1) = v^j2iE, - i?.-i)(2^ + ^) = + 0,(1), 

because 

.1=1 .1=1 



From ( I2.10p we have 
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which imphes Condition (ii) of Lemma [3l Look at Condition (i) of Lemma [3] 
next. It is easily seen that 

E,_i[£;,(sJs,)p = E,.(sJ)E,(s,) = ^ E 

ki<j,k2<j 

Furthermore, for the term corresponding to ki = k2, we have 

ki <j ki <j 

On the other hand, when ki ^ k2 

kiy^k'z k\^k2,hi^h2 kiy^k2 

It follows that 

(4.2) - y E,_,[EMs,)]' = -y ^^^^ + 0,(1) ^ 4c xdx = 2c. 
Therefore, by Lemma [3] 

(4.3) x/n(s^s - c„) iV(0, 2c). 

We conclude from Section 2 and 3 that Mn{z) converges weakly to a Gauss- 
ian process on C. Moreover, mn{z) — *• m{z) uniformly on C by (4.2) in ^ 
and (O). These, together with ffrT2l) . A . (12:231) and (O), give, for any 
constants ai and 02 

(4.4) aiXniz) + a2v^(^(||s|n - ^(c„)) 

= ~a,{z)Ms^A~\z)s - ^ ^""""^^l . ] + a2(^)v^(||sf - c„) + o,(l) 

1 + c„m„(2:) 

n 

i=i 

where di{z) = ai(l + cm{z)Y /c, d2{z) = a2g'{cn) — aim{z)/c, and 

_ 2 

/^•(2;) = ai(2;)r^-(2;) + d2iz)—Ej{sJsj). 

Here, the first Op(l) denotes convergence in probability to zero in the C space 
and in the first step we use the fact that g{x) = g{cn)+g'{a){x — Cn)+o{\x — Cn\) 
Thus, the tightness of X„(z) is from the tightness of Mn{z). 

Since bi{z) ^ 1/(1 + crn^z)) and 61(2;) —zm{z) by (2.17) of [5j, we have 

(4.5) 1/(1 + cm{z)) = -zm{z). 
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Moreover, we assume for the moment that 

It follows from (IZHTjl . M . M and (jMl) that 

+2ca2{zi)a2{z2)+ai{zi)a2{z2) +01(^2)02(^1) „ +Op(l) 

(l + cm(2;i))^ [l + cm[z2)) 

= alx ^M) + alx 2c{g\c)f + Op(l). 

Thus Lemma [T] follows from the above argument, LemmaOand Cramer- Wold's 
device. 

Consider (14. 6p now. Write 

E,_i[E,(sjATi(z)s,.)^.(sJs,)] = E,{f^)E,{A~:\z)-s,) 



i5^E,(sfA,7.i(;^)s,A,(^)) 
5^E,-(sf A-.i(^)s,A,(^)) + i 5^E,(sf Ar.i(^)s,,/3i,(z)), 



2<j Kj 



where we use Sj = 1/n ^ Sj in the second step and Sj = Sij + s^/n in the last 
step. By ([22D, fl2J0|) and ([21]) 

^I^E^^-(^^Ar.i(^)s,,(A,(^)) - h2{z))\ = 0{j=), 

which, together with (12.341) . yields 

E|^^i?,(sfAr;(^)s,,A,(^))| = o(l). 

On the other hand, appealing to (12. 6p . (12.71) and (12.81) ensures that 

1 ^ , T . 1/N ^/NN ? — 1 n~"^i?trA~^(2;) , , 
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Therefore, we obtain 

1 " 



n 



1 + n~^EtrA~^(z) n ^ ^ "^^^^^^ 

f4 7) cm(2:) 

^ ' ' ' 2(1 + cm(2))' 

Next, by the Markov inequahty and the Doob inequahty 

n 

P{m.w.-\^yik\>e) < ' ^ 



n 

4 



< = 0[n ). 

which imphes 

max — > fjfc — > U. 

It follows that 

n p 

< 



1 M 

< max I- V Wifcl — Ej(sJAt1(^2)At1(2;2)sj) 



«j n — ' n 

k<j j=i 



(4.8)^ 0, 

n 

because ( 12.16P implies that n^^ Yl ^ji^J ■^J'^ i^2)Aj'^ {z2)sj) is uniformly inte- 
grable. Based on (14. 8p and (14 we have (14. 6p . 

□ 

Proof of Remark [2] By (11.31) we get 

m{zi) - m(z2) m{zi)m{z2){l +ZZ2i(-2i))(l + ZZ2i(-22)) 



(4.9) 



{zi - Z2) (1 +ZZi('2i))(l + IR{z2)) - cm{zi)m{z2) 
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Then 



cziZ2[{l + 'ni{zi)){l + rniz2)) - cmJ^Zi)m{z2)\ 

2(777,(2:1) -rn{z2)) 

cziZ2{zi - Z2)mlzi)m{z2){l + 777(zi))(l + 777(^2)) 

2{m{zi) - m{z2)) 
ZiZ2{zi - Z2){1 + rn{zi)Y{l + 777(^2))^ 

2(777(^1) - 777(^2)) 



0^12:2(^1 - 2;2)(1 + 7?7,(2;i))(l +m{z2)) 
1 c 



777(^1)777(2:2) (1 + 777(2;i))(l +777(2:2)) 

2 (m(;zi) -777(^2)) 2 



^1-22(2:1 - Z2){1 + ?Z7(2:i))2(l + m{z2)Y cziZ2{l + m{zi)){l + 777(2:2)) 
2(771(2:1) — 771(2:2)) 2777(2:1)771(2:2) 



^12:2(2:1 - Z2)il + m(2:i))2(l + 777(^2))^ 

where in the first step and the third step we use fl4.9p and in the last step we 
use (14. 5p . On the other hand, via (11.31) one can verify that 

2(77l(zi) -777(^2)) _ 2(2:2777(^2) - 2:i777(zi))2 

ZlZ2{Zi - Z2){1 + 777(zi))2(l + 771(2:2) )2 €^2:12:2(2:1 - 2:2)(777(zi) - r7l(z2))' 

which is exactly the covariance function in Lemma 2 of |2j. Therefore, Remark 
[2] holds. 

Proof of Theorem [2l The idea from Lemma [1] to Theorem [2] is similar to 
that in [5]. First, by the Cauchy formula we have 

f{x)dG{x) = -i^-j fiz)mG{z)d{z), 

where the contour contains the support of G{x) on which f{x) is analytic. 
Then, with probability one, we have 

/(x)rfG'„(x) = ^ f{z)X„{z)d{z), 

for all n large, where the complex integral is over C and 

Gn{x) = V^{Fi{x)-F,„ix)). 

Further, 

f{z){X^{z) - M^))dz\ < ^, .... + r ^ 0, 

y/n{Ur - Amax(o)) y/n{Xram{<S) - Ul) 
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where, with probabihty one, Xma.xi'S) (1 + ^/c)'^ by |TT] and \mm{<S) — >■ 
(1 — a/c)^ by [26j. Second, note that for any constants Oi and 02 

y;) ^ ai y f{z)Xn{z)dz + aaF^ 

is a continuous mapping. Therefore, the right side above converges in distri- 
bution by Lemma [H Moreover, Remark [2] shows that (11. 6p follows from (1.12) 
and (1.15) in |2]. 

□ 

Proof of Theorem [H By taking f{x) = x^^ and g{x) = x in Theorem [2] and 
noting that c„ — c as n — > 00, we can complete the proof. □ 

5. Truncation of the underlying random variables 

To guarantee the results holding under the fourth moment, it is necessary 
to truncate and centralize the underlying r.v.'s at an appropriate rate. As in 
(1.8) in ^ one may select a positive sequence so that 

(5.1) En^O and e-^EX^J{\Xu\>enV^)^0. 

Set Xij = XijI{\Xij\ < En^fn) - EXijI{ \Xij\ < En^fn) and X„ = X„ - 
X, = (X,,) with X„ = (X,,). Let a„ = ^E|XnP, S„ = {nalY^±Si, and 

_ n 

K^^[z) = (S„ — zl)^^. Moreover, introduce s = - ^ Sj, where Sj is the j-th 
column of the matrix (cr„)~^X„. 

Lemma 7. Assume thatXij,i = 1, ■ ■ ■ ,p, j = 1, - ■ ■ ,n are i.i.d. with EXu = 
0,£'|Xiip = 1 and E\Xii\'^ < 00 , for z G , we have then 

(5.2) ^{fA-\z)s - ¥k~\z)l) ^ 0, 

where the convergence in probability holds uniformly for z & . Moreover, 

(5.3) V^is^s - Fi) ^ 0. 
Proof. Write 

y/n{s^A~^{z)s - S^A~'^{z)s) = Unl + U„2 + Un3 

where 

Unl = v^[(s - ^)^A-^{z)s], Un2 = \/n[^'^ (A^^ (z) - A"^(z))s] 

and 

Un3 = y/n[s'^A-\z){s - s)]. 
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Consider Uni on the C„ first. It is observed that 

\Unl\ < V^||(S-^)^||||A-1(Z)||||S|| <^| 

^^0 
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S - S 



(5.4) 



since 



n.^ 1 ,n_||2 \fn 1 ,,- 



< ^|i__|||sf + 



S S 



s — s = (1 — ^)s + with s = ^ Sj/ra and Sj being the j-th column 



of X„. Moreover, it follows from (15. ip that 

l-al < 2EXlJ{\X^^\ > SnV^) < 2e;;^n-'EX^,I{\Xu\ > SnM = 0(4^"'), 
which implies that 

(5.5) v^(l - 1/an) = V^ial - 1)/K(1 + a„)] = 0(^-^/2). 

On the other hand 

P ^ n 



n 

i=i j=i 



net. 

1=1 j=i '• 



which, via (15.11) . gives that 
(5.6) 

In addition, ||s|p is uniformly integrable because (12.151) remains true for k = 2 
without truncation by a careful check on its argument. This, together with 
(I5.4l) - (l5.6p . ensures that Uni converges in probability to zero uniformly on 

Analyze Un2 next. Since X„ — cr~^X„ = (1 — a~^)'K.n + cr~^X„ we have 



\Un2\ < V^||F||||A-^(Z) 



A-^(^)||||s||<^||F||||A(z)-A(z)||||s| 



< 



Is'^ll lls| 



Vn\/n 



|X„ — cT„^X„||||X^| 



kn^^ri||||X^ — (T^^X^I 



< 



I -Til ii-i 

s s 



(1 - ^n^)l|X„||||X^|| + cr„^||X„||||X^ 



Ha-'±J{1 - a-')\\^l\\ + \\a-'%,\\a-^^l\ 



As before, ||s|| and ||s|| are uniformly integrable. Moreover, the spectral 
norms ||X^||/A/n and ||(T^"'^X„||/-y^ both converge to (1 + -^/c)^ with proba- 



bility one by [25]. In addition, y nEXf^ converges to (1 + a/c)^ with 

probability one. From (I5.ip we have 

nEX^,, < 2e~^EXt,I{\Xn\ > = 0(5^), 
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which, together with (15.51) . yields that m„2 converges in probabihty to zero 
uniformly on Cu- 

Clearly, the argument for Uni works for Uns as well. Moreover, note that 
II A^^(2;)|| is bounded for z G Q, Ui < 0. As for z E C^ui > Q oi z E Cj., by [25j 
we have 

lim min(u, - Amax(A), Amm(A) - ui) > 0, a.s. 

n—foo 

and 

lim mm{ur - Amax(A), Amin(A) - ui) > 0, a.s. 

n— >oo 

Therefore the above argument for Unj,j = 1, 2, 3 for z G C„ of course applies 
to the cases (1). z G Ci,ui < 0; (2). z G Ci,ui > 0; (3) z G C,.. Thus, f lOj) 
holds. 

Finally, the above argument for (15.21) of course works for fl5.3p . We are 
done. □ 
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